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DEVICE AND METHOD FOR CORRECTING SKEW OF AN OBJECT IN AN 

IMAGE 

PRIORITY 

5 

This application claims priority under 35 U.S.C. § 119 to an application 
entitled "Device and Method for Correcting Skew of Object in Image" filed in the 
Korean Intellectual Property Office on January 30, 2003 and assigned Serial No. 2003- 
6417, the contents of which are incorporated herein by reference. 

10 

BACKGROUND OF THE INVENTION 

Field of the Invention: 

The present invention relates generally to a preprocessing device and method 
15 for recognizing image characters, and in particular, to a device and method for 
correcting a skew of an object in an input image before recognizing image characters. 

Description of the Related Art: 

Generally, a preprocessing operation is performed to recognize image 
20 characters. The "preprocessing operation" refers to an operation of processing an image 
before recognition of the characters in the image. The image preprocessing operation 
can include an operation of determining whether or not an input image is appropriate for 
character recognition, an operation of correcting the skew of an object in an input 
image, an operation of properly correcting the size of an input image, and an operation 
25 of binarizing an image signal (i.e. transforming an image function into a binary image) 
so that characters of the image signal can be recognized. 

A device for recognizing image characters generally recognizes characters 
from an image. Since the image is photographed by a camera, an object in the image 
30 may be skewed. Therefore, in order to increase a recognition rate, it is preferable to 
correct a skewed object in the mage before performing a recognition operation. 
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SUMMARY OF THE INVENTION 

It is, therefore, an object of the present invention to provide a device and 
method for correcting a skew of an object in an image during binarization of an image 
5 signal. 

It is another object of the present invention to provide a device and method for 
correcting a skew of an object in an input image by classifying the image into character 
blocks and background blocks and calculating a skew of the classified character blocks 
10 during binarization of an image signal. 

It is further another object of the present invention to provide a device and 
method for correcting a skew of an object in an input image by classifying the image 
into character blocks and background blocks, converting the character blocks into 
15 character strings and then calculating a skew angle of the object in the image according 
to a skew of the character strings during binarization of an image signal. 

It is yet another object of the present invention to provide a device and method 
for correcting a skew of an object in an input image by classifying character blocks 
20 during binarization of an image signal, creating candidate stripes by extending the 
binarized character region, selecting the longest and largest stripe among the generated 
candidate stripes, and then calculating a skew angle according to a skew of the selected 
stripe. 

25 It is still another object of the present invention to provide a device and method 

for correcting a skew of an object of an input image by classifying character blocks 
during binarization of an image signal, subsampling the binarized character blocks in a 
horizontal direction, creating candidate stripes by extending the binarized character 
region, selecting the long and largest stripe among the created candidate stripes, and 

30 then calculating a skew angle according to a skew of the selected stripe. 

In accordance with one aspect of the present invention, a device corrects a 
skew of an object in an image. The device comprises an input part for receiving an 
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image; a binarization part for binarizing pixels of the image into pixels having 
brightness values for character pixels and background pixels; a candidate stripe 
generation part for generating candidate stripes by performing dilation on character 
regions of the binarized image; a stripe classification part for classifying candidate 
5 stripes having a predetermined eccentricity and blob size among the candidate stripes, 
as valid stripes; a skew angle decision part for calculating direction angles of the 
classified stripes, and determining a direction angle having the largest count value as a 
skew angle; and a skew correction part for correcting a skew of an image by rotating the 
image by the skew angle. 

10 

In accordance with another aspect of the present invention, a device corrects a 
skew of an object in an image. The device comprises an input part for receiving an 
image; a binarization part for binarizing pixels of the image into pixels having 
brightness values for character pixels and background pixels; a horizontal pixel 

15 subsampling part for performing horizontal subsampling on the binarized image at a 
predetermined ratio; a candidate stripe generation part for dilating character blocks in 
the binarized image and generating candidate stripes; a vertical pixel subsampling part 
for performing vertical subsampling on the image having the candidate stripes at a 
predetermined ratio; a stripe classification part for classifying candidate stripes having a 

20 predetermined or larger eccentricity and blob size among the vertical-subsampled 
candidate stripes, as valid stripes; a skew angle decision part for calculating direction 
angles of the classified stripes, and determining a direction angle having the largest 
count value as a skew angle; and a skew correction part for correcting a skew of an 
object in an image by rotating the mage by the skew angle. 

25 

In accordance with further another aspect of the present invention, a method 
corrects a skew of an object in an image. The method comprises the steps of receiving 
an image; binarizing pixels of the image into pixels having brightness values for 
character pixels and background pixels; dilating character regions of the binarized 
30 image and generating candidate stripes; classifying candidate stripes having a 
predetermined or larger eccentricity and blob size among the candidate stripes, as valid 
stripes; calculating direction angles of the classified stripes; determining a direction 
angle having the largest count value among direction angles as a skew angle; and 
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correcting a skew of an image by rotating the mage by the skew angle. 

In accordance with further another aspect of the present invention, a method 
corrects a skew of an object in an image. The method comprises the steps of receiving 
5 an image; binarizing pixels of the image into pixels having brightness values for 
character pixels and background pixels; performing horizontal subsampling on the 
binarized image at a predetermined ratio to reduce horizontal pixels; dilating character 
blocks in the vertical-subsampled binarized image and generating candidate stripes; 
performing vertical subsampling on the binarized image having the candidate stripes at 

10 a predetermined ratio to reduce vertical pixels; classifying candidate stripes having a 
predetermined or above eccentricity and blob size among the vertical-subsampled 
candidate stripes, as valid stripes; calculating direction angles of the classified stripes; 
accumulating the direction angles and determining a direction angle having the largest 
count value as a skew angle; and correcting a skew of an object in an image by rotating 

1 5 the mage by the skew angle. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above and other objects, features and advantages of the present invention 
20 will become more apparent from the following detailed description when taken in 
conjunction with the accompanying drawings in which: 

FIG 1 is a block diagram illustrating a structure of a device for correcting a 
skew of an object in an image according to a first embodiment of the present invention; 

FIG 2 is a block diagram illustrating a structure of a device for correcting a 
25 skew of an object in an image according to a second embodiment of the present 
invention; 

FIG 3 is a detailed block diagram illustrating a structure of the binarization 
part shown in FIGs. 1 and 2; 

FIG 4 is a detailed block diagram illustrating a structure of the block 
30 classification part shown in FIG 3; 

FIGs. 5A through 5C are diagrams illustrating characteristics for calculating a 
sum of absolute values of dominant DCT coefficients in an energy calculation part of a 
block classification part; 
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FIG 6 is a graph illustrating a method for calculating a skew angle of a stripe 
in the skew angle decision part shown in FIGs. 1 and 2; 

FIG 7 is a flowchart illustrating a method for correcting a skew of an image 
according to an embodiment of the present invention; 
5 FIG 8 is a flowchart illustrating a method for correcting a skew of an image 

according to another embodiment of the present invention; 

FIG 9 is a flowchart illustrating a method for classifying an image into blocks 
in the binarization process of FIGs. 7 and 8; 

FIG 10 is a flowchart illustrating a method for binarizing classified character 
10 blocks and background blocks binarized in the binarization process of FIGs. 7 and 8; 

FIG 11 is a flowchart illustrating the candidate stripes generation methods of 
FIGs. 7 and 8; 

FIG 12 is a flowchart illustrating a method including the stripe classification 
process and the skew angle decision process FIGs. 7 and 8; 
15 FIG 13 is a flowchart illustrating the overall skew correction method according 

to an embodiment of the present invention; and 

FIGs. 14A through 14H are diagrams illustrating shapes of an image generated 
in each process of FIG 13. 

20 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

In the following description, specific details such as a size of an image and 
sizes of character and background blocks are provided as examples. It should be 
obvious to those skilled in the art that the invention can be implemented without the 
25 examples or by modifying the examples. 

In embodiments of the present invention, an input image is assumed to have a 
size of 640x480 pixels. The term "block" refers to character and background blocks, 
and it is assumed herein that each of the blocks has a size of 8x8 pixels. In addition, the 
30 term "grouped block" refers to surrounding blocks of a center block to be binarized, and 
it is assumed herein that each of the surrounding blocks has a size of 24x24 pixels. 

In addition, the term "character string" as used herein refers to a string 
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including separated characters, and the term "stripe" refers to a plurality of characters 
arranged densely at regular intervals, forming a stripe. In the embodiments of the 
present invention, a skew of an object in an image is corrected by calculating a direction 
angle formed by the stripes. A second embodiment of the present invention described 
5 below provides a device and method for correcting a skew of an object in an image 
using the stripes. 

Embodiments of the present invention will now be described in detail with 
reference to the accompanying drawings. 

10 

FIG 1 is a block diagram illustrating a structure of a device for correcting a 
skew of an object in an image according to a first embodiment of the present invention. 
Referring to FIG 1 , an input part 1 1 0 has a function of receiving an input image. Here, a 
camera, a scanner, a communication interface including a modem and a network, and a 
15 computer can serve as the input part 110. It is assumed herein the input image is 
comprised of 640 (column) x 640 (row) pixels. 

A binarization part 120 divides the image received from the input part 110 into 
blocks, classifies the divided blocks into character blocks and background blocks by 
20 analyzing pixels included in the divided blocks, and then binarizes the pixels in each of 
the blocks. The binarization part 120 classifies the blocks- into character blocks and 
background blocks in order to binarize a region where characters are included and then 
classify character strings using the binarization results. As mentioned above, it is 
assumed herein that each of the blocks has a size of 8x8 pixels. 

25 

A candidate stripe generation part 180 performs dilation on a region of the 
character blocks and then generates candidate stripes in which neighboring characters 
are connected. The candidate stripe generation part 180 performs dilation on the region 
of the binarized character blocks and then generates candidate stripes in which 
30 neighboring characters are connected. Further, the candidate stripe generation part 180 
performs erosion on the character blocks in order to prevent the candidate stripes 
neighboring up and down in the dilation process from being connected with each other. 
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A stripe classification part 135 classifies stripes having a predetermined size or 
above among the candidate stripes. The stripe classification part 135 calculates a blob 
size and/or eccentricity using the binarized candidate stripes and then classifies the 
stripes having the predetermined size or larger. The stripes are used for calculating a 
5 direction angle of an object, within the image, skewed with respect to a horizontal axis 
of the image. 

A skew angle decision part 140 calculates direction angles of the classified 
stripes, accumulates count values of the direction angles angle by angle, selects a 
10 direction angle having the largest count value, and determines the selected direction 
angle as a skew angle of an object within the image. The skew angle decision part 140 
calculates the direction angles of the character strings, accumulates the count values of 
direction angles angle by angle, and determines a direction angle having the largest 
count value as a skew angle. 

15 

A skew correction part 150 receives an input image signal output from the 
input part 110, rotates the image signal based on the skew angle determined by the skew 
angle decision part 140, and corrects a skew of an object in the received image. 

20 An image correction part 160 inserts an image signal into a comer of the image 

in which the skew of the object is corrected. That is, if the skew correction part 150 
corrects the skew of the object within the image, a region in which no pixel exists 
occurs due to the rotation of the image. The image correction part 160 fills specified 
pixels in an empty region of the image, caused by the skew correction. Because the 

25 pixels are filled irrespective of character data, an output of the skew correction part 150, 
even though it is directly output to a recognition part 170, does not affect the process of 
recognizing characters from the detected image. 

The recognition part 170 recognizes an image signal output from the image 
3 0 correction part 1 60. 

FIG 2 is a block diagram illustrating a structure of a device for correcting a 
skew of an object in an image according to a second embodiment of the present 
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invention. Referring to FIG. 2, an input part 110 has a function of receiving an input 
image. Here, a camera, a scanner, a communication interface including a modem and a 
network, and a computer can serve as the input part 110. It is assumed herein the input 
image is comprised of 640 (column) x 640 (row) pixels. 

5 

A binarization part 120 divides the image received from the input part 110 into 
blocks, classifies the divided blocks into character blocks and background blocks by 
analyzing pixels included in the divided blocks, and then binarizes the pixels in each of 
the blocks. The binarization part 120 classifies the blocks into character blocks and 
1 0 background blocks in order to binarize a region where characters are included and then 
classify character strings using the binarization results. As mentioned above, it is 
assumed herein that each of the blocks has a size of 8x8 pixels. 

A horizontal pixel subsampling part 190 performs horizontal subsampling on 
1 5 the binarized image and then reduces horizontal pixels of the image. The horizontal 
pixel subsampling part 190 reduces the horizontal pixels in order to allow character 
strings to be appropriately horizontally arranged in the horizontal direction when 
candidate stripes are generated. 

20 A candidate stripe generation part 180 performs dilation on a region of the 

character blocks and then generates candidate stripes in which neighboring characters 
are connected. The candidate stripe generation part 180 performs dilation on the region 
of the binarized character blocks and then generates candidate stripes in which 
neighboring characters are connected. Further, the candidate stripe generation part 180 

25 performs erosion on the character blocks in order to prevent the neighboring (e.g., 
adjacent) candidate stripes in the dilation process from being connected with each other. 

A vertical pixel subsampling part 195 performs vertical subsampling on the 
image converted into the candidate stripes at a reduction ratio of the horizontal pixels, 
30 and reduces vertical pixels. The vertical pixel subsampling part 195 recovers an original 
aspect ratio from an aspect ratio changed due to the horizontal pixel reduction by the 
horizontal pixel subsampling part 1 90. Even though the horizontal pixels are increased 
in number, the vertical pixel subsampling part 195 can recover the original aspect ratio. 



-8- 



P11075/ST (2003-6417) 



A stripe classification part 135 classifies stripes having a predetermined size or 
larger among the candidate stripes in which the vertical pixels are reduced in number. 
The stripe classification part 135 calculates a blob size and/or eccentricity using the 
5 binarized candidate stripes and then classifies the stripes having the predetermined size 
or larger. The stripes are used for calculating a direction angle of an object, within the 
image, skewed with respect to a horizontal axis of the image. 

A skew angle decision part 140 calculates direction angles of the classified 
10 stripes, accumulates count values of the direction angles angle by angle, selects a 
direction angle having the largest count value, and determines the selected direction 
angle as a skew angle of an object within the image. The skew angle decision part 140 
calculates the direction angles of the character strings, accumulates the count values of 
direction angles angle by angle, and determines a direction angle having the largest 
1 5 count value as a skew angle. 

A skew correction part 150 receives an input image signal output from the 
input part 110, rotates the image signal based on the skew angle determined by the skew 
angle decision part 140, and corrects a skew of an object in the received image. 

20 

An image correction part 160 inserts an image signal into a corner of the image 
in which the skew of the object is corrected. That is, if the skew correction part 150 
corrects the skew of the object within the image, a region in which no pixel exists 
occurs due to the rotation of the image. The image correction part 160 performs a 
25 function of filling specified pixels in an empty region of the image, caused by the skew 
correction. Because the pixels are filled irrespective of character data, an output of the 
skew correction part 150, even though it is directly output to a recognition part 170, 
does not affect the process of recognizing characters from the detected image. 

30 The recognition part 170 recognizes an image signal output from the image 

correction part 160. 

Operation of the device for correcting a skew of an object in an image 
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according to the first embodiment of the present invention will now be described in 
detail. The binarization part 120 divides an input image into blocks, classifies the 
divided blocks into character blocks and background blocks, and then binarizes image 
pixels of the classified character blocks and background blocks into character pixels and 
5 background pixels. The candidate stripe generation part 1 80 then performs dilation on 
character regions in the binarized image so that neighboring characters can be connected 
to each other, and makes vertical stripes using character strings having characters. Here, 
the character strings in the form of a stripe are called "candidate stripes." Thereafter, the 
stripe classification part 135 classifies stripes having a predetermined size or larger and 

10 having a long shape among the candidate stripes. The skew angle decision part 140 
calculates direction angles of the classified stripes, and determines a direction angle 
having the largest count value among the calculated direction angles as a skew angle. 
The skew correction part 150 then corrects a skew of an object in the image by rotating 
the input image by the skew angle. The image correction part 160 corrects the image by 

15 inserting pixels into the regions where no pixel exists in the image in which the skew of 
the object is corrected, and then outputs the corrected image to the recognition part 170. 
Alternatively, the image correction part 150 may directly provide its output to the 
recognition part 170 without the image correction so as to allow the recognition part 170 
to recognize characters in the image. 

20 

Operation of the device for correcting a skew of an object in an image 
according to the second embodiment of the present invention will now be described in 
detail. The binarization part 120 divides an input image into blocks, classifies the 
divided blocks into character blocks and background blocks, and then binarizes image 

25 pixels of the classified character blocks and background blocks into character pixels and 
background pixels. The horizontal pixel subsampling part 190 performs horizontal 
subsampling on the binarized image. That is, the horizontal pixel subsampling part 190 
reduces the horizontal pixels in order to allow character strings to be appropriately 
horizontally arranged in the form of stripes in the following candidate stripe generation 

30 part 180. The candidate stripe generation part 180 then performs dilation on character 
regions in the binarized image so that neighboring characters can be connected to each 
other, and makes vertical stripes using character strings having characters. Here, the 
character strings in the form of a stripe are called "candidate stripes." Thereafter, the 
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vertical pixel subsampling part 195 performs vertical subsampling on the image 
converted into the candidate stripes at a preset ratio, and recovers an original aspect 
ratio. Thereafter, the stripe classification part 135 classifies stripes having a 
predetermined size or larger and having a long shape among the candidate stripes in 
5 which the horizontal and vertical pixels are subsampled at a preset ratio. The skew angle 
decision part 140 calculates direction angles of the classified stripes, and determines a 
direction angle having the largest count value among the calculated direction angles as a 
skew angle. The skew correction part 150 then corrects a skew of an object in the image 
by rotating the input image by the skew angle. The image correction part 160 corrects 
10 the image by inserting pixels into the regions where no pixel exists in the image in 
which the skew of the object is corrected, and then outputs the corrected image to the 
recognition part 170. Alternatively, the image correction part 150 may directly provide 
its output to the recognition part 170 without the image correction so as to allow the 
recognition part 170 to recognize characters in the image. 

15 

In the first and second embodiments of the present invention, the stripe 
classification part 135 calculates eccentricity and/or a blob size of each stripe, and 
outputs a signal for calculating a direction angle of each stripe. Here, the stripe 
classification part 135 classifies stripes for calculating a direction angle using stripes in 
20 which the binarized characters are connected to each other. Operations of the first and 
second embodiments of the present invention will now be described in detail. Herein, an 
operation of the device for correcting a skew according to the second embodiment will 
be described in detail. 

25 The input part 110 receives an input image. The input image has a size of NxM 

pixels. In the embodiment of the present invention, it is assumed that the input image 
has a size of 640 (N) x480 (M) pixels. In addition, the input image can be processed to 
be a color image or a gray image not having color information. In the embodiment of 
the present invention, it is assumed that the input image is a gray image. 

30 

The binarization part 120 divides the input image into blocks, classifies the 
blocks into character blocks and background blocks, and binarizes classified block 
images. 
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FIG 3 is a detailed block diagram illustrating a structure of the binarization 
part 120. The binarization part 120 divides the input image into blocks with a 
predetermined size, classifies the blocks into character blocks and background blocks, 
5 and binarizes pixels of the classified block images into character pixels and background 
pixels. The binarization part 120 classifies the blocks into the character blocks and 
background blocks and then binarizes the block image pixels in order to detect direction 
angles of character strings and hence detect a skew angle of an object for the image in 
the process of correcting the skew of the object for the image. 

10 

Referring to FIG 3, a block classification part 211 divides the input image into 
blocks having a preset block size and classifies the divided blocks into character blocks 
and background blocks. A block grouping part 213 groups each of the character blocks 
along with 8 adjacent blocks, and a pixel threshold calculation part 215 generates a 

15 threshold from the grouped blocks. A pixel decision part 217 collectively converts 
pixels of the background blocks output from the block classification part 211 into 
background pixels having a second brightness value using the threshold output from the 
pixel threshold calculation part 215. The pixel decision part 217 binarizes the pixels of 
the character blocks into character pixels having a first brightness value and background 

20 pixels having the second brightness value based on the threshold. 

FIG. 4 is a detailed block diagram illustrating a structure of the block 
classification part 120 in FIG 3. Referring to FIG 4, a block division part 311 divides 
an input image into blocks having a predetermined size. When the image has 640x480 
25 pixels and each of the blocks has 8x8 pixels, the block division part 311 divides the 
input image into 4800 blocks. 

The blocks output from the image dividing part 311 are applied to a discrete 
cosine transform (DCT) conversion part 313, and the DCT conversion part 313 
30 performs DCT conversion on the blocks. An energy calculation part 315 calculates a 
sum of absolute values of dominant DCT coefficients within the DCT-converted blocks. 
An energy distribution value of the DCT coefficients within the character blocks is 
larger than that of DCT coefficients within the background blocks. FIG 5 A is a diagram 
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illustrating a comparison of energy distributions of DCT coefficients for the character 
blocks and the background blocks. In FIG 5 A, a Y axis represents an average of the 
absolute sums in a log scale, and an X axis represents a zigzag scan order of the DCT 
coefficients. As illustrated in FIG. 5 A, it can be noted that DCT coefficients of the 
5 character blocks are larger in their average values than the DCT coefficients of the 
background blocks. FIG 5B is a diagram illustrating an energy distribution 
characteristic of DCT coefficients for the character blocks. In FIG 5B, a Y axis 
represents an average of the absolute sums in a normal scale, and an X axis represents a 
zigzag scan order of the DCT coefficients. As illustrated in FIG 5B, it can be noted that 
10 an average of absolute sums of some DCT coefficients for the character blocks is 
relatively larger. Thus, in the embodiment of the present invention, it is assumed that the 
dominant DCT coefficients used in a block classification process are Dj to D 9 shown in 
FIG 5C. Accordingly, a sum of the absolute values of the dominant DCT coefficients in 
a k th block can be calculated by 

15 

(!) 

In Equation (1), |z>*| denotes an i th dominant DCT coefficient of the k th block, 

and S k denotes the sum of the absolute values of the dominant DCT coefficients in the 
20 k th block. Thus, in the embodiment of the present invention, a sum of absolute values of 
the dominant DCT coefficients Di to D 9 is calculated. 

The energy calculation part 315 performs calculation of Equation (1) on all 
blocks (at k = 0, 1, 2, ... , 4799). Energy values S* (k = 0, 1, 2, ... , 4799) calculated 
25 block by block are applied to a block threshold calculation part 317. 

The block threshold calculation part 317 sums the energy values S k (k = 0, 1, 
2, ... , 4799) calculated block by block, and produces an average value <S*> by dividing 
the summed energy value by the total number TBN of blocks. The average value (S k ) 
30 is calculated by Equation 2 below. The average value (S k ) becomes a block threshold 
Cth used for determining the blocks as character blocks or background blocks. 



- 13- 



P11075/ST (2003-6417) 



1 



TBN 



{S k ) = -^—Ys 



TBN ti 
= Cth 



(2) 



In Equation (2), TBN denotes the total number of blocks. 



5 A classification part 319 sequentially receives energy values (corresponding to 

sums of the absolute values of dominant DCT coefficients) output from the energy 
calculation part 315 on a block-by-block basis. The classification part 319 classifies the 
blocks as character blocks or background blocks by comparing the received block 
energy values with the block threshold Cth . At this time, the classification part 319 
10 classifies the corresponding block #BN as a character block (CB) if S k >Cth 9 and 
classifies the corresponding block #BN as a background block (BB) if S k < Cth as 
defined in Equation (3) below. 

IF S k > Cth then CB 
elseBB 

15 

The pixels of character blocks classified by the block classification part 211 
can have gray levels between 0 and 255. An image of a character block output from the 
block classification part 211 is input into the block grouping part 213 and the pixel 
decision part 217. 

20 

The classified blocks output from the block classification part 211 are applied 
to the block grouping part 213. At this time, the binarization part 120 collectively 
converts the background blocks into background pixels in order to classify character 
strings of the image. Thus, it is assumed that the binarization part 120 does not perform 
25 block grouping and threshold calculation operations on the background blocks. 

The block grouping part 213 groups 8 adjacent blocks centering on each of the 
character blocks output from the block classification part 211 to thereby generate a 
grouped block having a size of 24x24 pixels. The character block has a size of 8 x 8 
30 pixels. If a threshold for distinguishing background pixels from character pixels is 
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determined using only one character block having such a size and a binarization process 
is performed based on the determined threshold, discontinuity between blocks in the 
binarized image can occur as a size of a block is very small and a difference between the 
threshold and adjacent character block values is very large. Thus, it is possible to 
5 improve reliability of binarization by generating the grouped block and extending a 
region for the binarization. 

The pixel threshold calculation part 215 calculates a pixel threshold Pth for 
classifying each pixel of the character block as a character or background pixel. The 

10 pixel threshold calculation part 215 produces the pixel threshold Pth , and the pixel 
threshold Pth is used for classifying each pixel of the character block as a character or 
background pixel and binarizing the character or background pixel. The pixel threshold 
Pth can be selected using Otsu's method or Kapur's method that selects a gray value 
having the maximum between-class variance between two types of pixels. It is assumed 

15 that the pixel threshold Pth is calculated using Otsu's method. The calculation of the 
pixel threshold Pth using Otsu's method is based on Equation (4) below. The method 
made by N. Otsu is disclosed in "A Threshold Selection Method from Gray-Level 
Histograms", IEEE Trans. Systems, Man and Cybernetics, Vol. SMC-9, No. 1, pp. 62- 
66, Jan. 1979, which is incorporated herein by reference. 

20 

Th } — arg max a\ (T) 

T 

a\ (T) = /> (//, (T) -ju) 2 +P 2 (r)(V 2 (T) - 

= P x (T)P 2 (T)( Mi (T)-MT)) 2 

a\ (T) : between - class variance (4) 

T : gray value 

ju : mean of the total pixels 

: mean of each class defined by T 
Pf(T) : relative frequency of each class 

The pixel decision part 217 binarizes the character block pixels output from the 
block classification part 211 into character and background pixels using the pixel 
25 threshold, and collectively binarizes the background block pixels into background 
pixels. That is, the pixel decision part 217 compares the pixel threshold Pth 
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corresponding to the received character block image with values of the character block 
pixels, classifies image pixels as character pixels if the values of the character block 
pixels are equal to or larger than the pixel threshold Pth , and classifies image pixels as 
background pixels if the values of the character block pixels are smaller than the pixel 
5 threshold Pth . The pixel decision part 217 performs the binarization operation by 
converting the character pixels into pixels having a brightness value "a" and 
converting the background pixels into pixels having a brightness value " /? " according 

to the classification results. A method for binarizing character block pixels by means of 
the pixel decision part 217 is defined as 

10 

iajf y(m 9 n)>Pth 

y B (m,n) = < . (5) 

[ p, otherwise 

In Equation (5), y(m, n) denotes pixels of the character block output from the 
block classification part 211, Pth is the pixel threshold, and y B (m,n) denotes pixels of 
1 5 the binarized character blocks. 



The pixel decision part 217 receives pixels of the background block output 
from the block classification part 211, and collectively converts the background block 
pixels into pixels having the brightness value " /? 

The image binarized by the binarization part 120 can be input to the candidate 
stripe generation part 180 or the horizontal pixel subsampling part 190. Here, it is 
assumed that the binarized image is input to the horizontal pixel subsampling part 190. 



25 The horizontal pixel subsampling part 190 performs horizontal subsampling on 

the binarized image at a preset ratio. Assuming that a subsampling ratio is 2:1, the 
horizontal pixel subsampling part 190 performs horizontal subsampling on the binarized 
image at the subsampling ratio of 2:1, and thus reduces the number of horizontal pixels 
of the binarized image by 1/2. The horizontal pixels are reduced in order to allow the 

30 candidate stripe generation part 180 to appropriately arrange character strings in the 
form of stripes. 
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The candidate stripe generation part 180 receives the binarized image output 
from the binarization part 120 or receives the horizontally-reduced binarized image 
output from the horizontal pixel subsampling part 190. The candidate stripe generation 
part 1 80 makes stripes out of the character strings of the received image. The candidate 
5 stripe generation part 180 can be implemented by a morphological filter having a 
dilation part and an erosion part. The morphological filter performs dilation and erosion 
on a character region so that characters are close to one another. That is, the dilation part 
performs dilation on the binarized character region, such that neighboring characters 
become close to one another and hence character strings in which characters are close to 

10 one another are generated. Here, the generated character strings can be referred to as 
"candidate stripes." Furthermore, the erosion part performs erosion on the generated 
candidate stripes. Adjacent up and down candidate stripes connected by the dilation 
operation can be separated by the erosion operation. The above-described 
morphological filter is disclosed in a reference entitled "Digital Image Processing," by 

15 R. C. Gonzalez, R. Woods, et al., 2 nd ed., Prentice Hall, pp. 519-560, 2002, which is 
incorporated herein by reference. 

The vertical pixel subsampling part 195 vertically subsamples the image output 
from the candidate stripe generation part 180 at a preset ratio. Here, it is assumed that a 

20 subsampling ratio is 2:1 as in the horizontal pixel subsampling part 190. The vertical 
pixel subsampling part 195 can be used for converting the ratio of width to length 
corresponding to the image reduced by the horizontal pixel subsampling into an original 
image aspect ratio. The vertical pixel subsampling part 195 vertically reduces the image 
by 1/2 to output the reduced image. Here, a horizontal pixel extension part can be used 

25 in place of the horizontal pixel subsampling part 195 so that a size restoration to the 
original image can be achieved. 

The stripe classification part 135 can receive an output image being a binarized 
image from the binarization part 120, an output image from the candidate stripe 
30 generation part 180 or an output image from the vertical pixel subsampling part 195. 
Here, it is assumed that the stripe classification part 135 receives the output image from 
the vertical pixel subsampling part 195. 
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The stripe classification part 135 labels stripe numbers for the candidate stripes 
generated from the binarized image. The candidate stripes having the labeled stripe 
numbers are used for calculating a direction angle. Then, the stripe classification part 
135 analyzes the candidate stripes having the labeled stripe numbers, and discriminates 
5 stripes having a predetermined length or larger and having a long shape from the 
candidate stripes. The candidate stripe classification method uses a blob size and 
eccentricity based on a moment. Equation (6) below defines a centroid moment to be 
used when a blob size and eccentricity are calculated, the blob size is calculated at p = 0 
and q = 0 in Equation (6). Equation (7) shows a method for calculating the eccentricity 
10 using the centroid moment. The eccentricity calculation method is disclosed in a 
reference entitled "Digital Image Processing Algorithms," by Pitas, Prentice Hall, pp. 
326-331, 1993, which is incorporated herein by reference. 

x y 

x : horizontal centroid of object 
y : vertical centroid of object 

15 

c= 4 f i n +Qu 20 -/J 02 f 

In Equation (7), the eccentricity e denotes a length of a candidate stripe. 

20 The blob size n (= /j oq ) and eccentricity e calculated by Equations (6) and (7) 

are compared with preset thresholds juth and eth, thus to select candidate stripes as 
valid stripes. Here, the thresholds juth and eth are calculated using a predetermined 
experiment. Where ju > juth and/or e>eth, a corresponding candidate stripe is 
classified as a valid stripe. However, any one or both of the blob size // and the 

25 eccentricity e are smaller than their thresholds juth and eth, the candidate stripe is not 
selected as a valid stripe. That is, under this condition, it is determined that the 
corresponding candidate stripe is not appropriate for calculation of a direction angle, so 
the stripe is not selected as a valid stripe. In the embodiment of the present invention, a 
candidate stripe capable of satisfying the conditions that /u > juth and e > eth is 

30 selected as a valid stripe. In an alternative embodiment of the present invention, a 



(6) 

(7) 
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candidate stripe can be determined to be a valid stripe according to only any one of the 
two conditions. 

The stripes classified by the stripe classification part 135 are input into the 
5 skew angle decision part 140, and the skew angle decision part 140 calculates a 
direction angle 6 for each of the classified stripes, and accumulates and stores count 
values of calculated direction angles. A direction angle having the largest count value is 
determined to be a skew angle. FIG. 6 is a graph illustrating a method for calculating a 
skew angle of a stripe in the skew angle decision part 140 according to an embodiment 

10 of the present invention. In FIG 6, CS denotes a stripe classified by the stripe 
classification part 135, and an x' axis and a y' axis are coordinate axes associated with 
the stripe CS. Thus, a direction angle 6 between the x' axis and a real X axis for each 
of stripes output from the stripe classification part 135 is calculated, and count values of 
directions angles 6 are accumulated and stored. The direction angle 6 for the stripe CS 

1 5 can be calculated by 

0=- arctan( 2 ^ u — ) (8) 

2 M20 ~ M02 

After direction angles 9 for all stripes have been completely calculated, the 
20 skew angle decision part 140 analyzes the accumulated count values of direction angles 
0 , and determines a direction angle 0 having the largest count value as a skew angle. 
In other words, the skew angle decision part 140 determines a direction angle 6 
associated with a largest number of stripes as the skew angle. 

25 If the skew angle has been determined, the skew correction part 150 rotates an 

input image output from the input part 110 by the skew angle determined by the skew 
angle decision part 140 to correct a skew of image signals. That is, the skew correction 
part 150 rotates the image on the basis of a rotation matrix if the skew angle has been 
determined. At this time, an inverse mapping method can be used in rotating the image. 

30 The inverse mapping and rotation methods are disclosed in a reference entitled 
"Handbook of Computer Vision and Applications," by B. Jahne, et al., Academic Press, 
Vol. 2, pp. 94-95, 1999, and a reference entitled "Computer Vision", by L. G Shapiro 
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and G C. Stockman, Prentice Hall, pp. 415-418, 2001, both of which are incorporated 
herein by reference. 

If the skew correction part 150 rotates the image, a blank space in which no 
5 pixel exists is formed at a corner of the image. The blank space can affect the following 
recognition process. The image correction part 160 performs a function of filling 
specified pixels in the blank space formed at the corner of the image in which the skew 
is corrected. When filling the pixels in the blank space formed at the corner of the image 
in which the skew is corrected, the image correction part 160 can fill pixels having the 
10 pixel values closest to the blank space in the blank space. A correction process for the 
blank space can be collectively performed on the basis of a brightness value of 
background pixels. 

When characters are recognized from the input image, stripes of character 
1 5 strings are extracted from the input image, direction angles are calculated according to 
skews of the stripes, the most frequently calculated direction angle among the calculated 
direction angles is determined as a skew angle, and the image is rotated on the basis of 
the determined skew angle. In this manner, the image in which a skew of an object is 
corrected can be created. Furthermore, as pixels of a specific pixel brightness value are 
20 filled in a blank space formed at the comer of the image when the skew of an object in 
the image is corrected, an error can be reduced in the recognition process. 

FIG. 7 is a flowchart illustrating a method for correcting a skew of an image 
according to a first embodiment of the present invention. If a candidate stripe generation 

25 process of step 415 is omitted from FIG 7, it becomes a method for correcting a skew of 
an image according to the first embodiment of the present invention. FIG 8 is a 
flowchart illustrating a method for correcting a skew of an image according to a second 
embodiment of the present invention. It should be noted that similar steps will use the 
same labels, and FIGS. 7, 8, 9, and 10 will be discussed simultaneously. The method for 

30 correcting a skew of an image according to the second embodiment of the present 
invention further includes a horizontal pixel subsampling process of step 414 and a 
vertical pixel subsampling process of step 416 in addition to the method according to 
the first embodiment of the present invention. It should also be noted that FIG 7 is 
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substantially the same as FIG 8 except FIG 8 includes the additional step 414 and step 
416. Herein, a description of the present invention will be concentrated on the method 
for correcting a skew of an image illustrated in FIG 8. 

5 Referring to FIG 8, if an input image is received in step 411, then an operation 

of dividing the received image into blocks, classifying the divided blocks into character 
blocks and background blocks and then binarizing images pixels of the classified 
character blocks and background blocks into character pixels and background pixels is 
performed in step 413. In the binarization process of step 413, a process of classifying 
10 the blocks into character blocks and background blocks is achieved in the method of 
FIG 9, and a process of binarizing the classified character blocks and background 
blocks is achieved in the method of FIG. 10. 

Referring now to FIG 9, the method for classifying an image into blocks will 
15 be described. When the image is received, the received image is divided into blocks 
having a predetermined size in step 511. Here, it is assumed that the image has 640x480 
pixels and each of the blocks has 8x8 pixels. Therefore, the image is divided into 4800 
blocks. 

20 In step 513, a block number BN is set to 0, and in step 515, a block with the 

block number #BN is accessed. In step 517, the accessed block is DCT-converted, and 
in step 519, a sum S k of absolute values of dominant DCT coefficients in the DCT- 
converted BN block is calculated and stored. At this point, energy distribution of the 
DCT coefficients for the character blocks has a larger value than that of the DCT 

25 coefficients for the background blocks, and energy distributions of the DCT coefficients 
for the character blocks and background blocks are illustrate in FIG 5A. The energy 
distribution of the DCT coefficients for the character blocks have a characteristic shown 
in FIG 5B. Therefore, a sum S k of absolute values of the DCT coefficients in a k th block 
can be calculated in accordance with Equation (1). Here, 'k' is the same parameter as 

30 BN, and denotes a block number. After the S k is calculated in step 519, it is determined 
in step 521 whether S k of the last block is calculated. If S k of the last block is not 
calculated, the method increases the block number by one in step 523 and then returns 
to step 5 1 5 to repeat the above operation. 
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Through repetition of the steps 515 to 523, all blocks (k=0, 1, 2, ... , 4799) are 
DCT-converted in accordance with Equation (1). In addition, a threshold Cth is 
calculated using energy values S k (k=0, 1,2,..., 4799) of the blocks. That is, in step 
5 525, energy values S k (k=0, 1, 2, ... , 4799) calculated for the blocks are summed up, 
and then, an average value <S k > is calculated by dividing the summed energy value of 
all the blocks by the total number TBN of the blocks. Here, the value <S k > is calculated 
using Equation (2), and the calculated <S k > value becomes a threshold Cth used for 
determining the image block as a character block or a background block. 

10 

After the threshold Cth is calculated, an operation of classifying the blocks into 
character blocks and background blocks is performed. For this, in step 527 the block 
number BN is initialized to c 0\ and in step 529, S k of a block corresponding to the 
block number BN is accessed. Thereafter, in step 531, the classification part 319 

15 classifies the block corresponding to the block number BN as a character block or a 
background block by comparing a value S k of the block with the threshold Cth. In the 
block classification process, the classification part 319 classifies in step 533 the 
corresponding block #BN as a character block if S k > Cth, and classifies in step 535 the 
corresponding block #BN as a background block if S k < Cth, as shown in Equation (3). 

20 Thereafter, it is determined in step 537 whether a corresponding block is the last block. 
If the corresponding block is not the last block, the method increases the block number 
by one in step 539, and then returns to step 529 to repeat the above operation. When the 
operation is completed, the block classification result is output. After the image is 
divided into blocks having a predetermined size, the blocks are classified into character 

25 blocks and background blocks. 

The classified character blocks undergo block grouping. That is, each of the 
character blocks is grouped along with 8 adjacent blocks, creating a grouped block 
having a size of 24x24 pixels. In addition, a pixel threshold Pth for classifying pixels in 
30 the character blocks into character pixels and background pixels is calculated using the 
grouped blocks. The pixel threshold Pth is used for distinguishing character pixels from 
background pixels during binarization. At this point, the pixel threshold Pth is 
calculated using Otsu's method or Kapur's method that selects a gray value having the 
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maximum between-class variance between two types of pixels. It is assumed herein that 
the pixel threshold Pth is calculated using Otsu's method in accordance with Equation 
(4). 

5 An operation of binarizing image pixels of the character blocks is performed 

using the pixel threshold Pth. The binarization process is performed in the method of 
FIG 10. 

Referring to FIG. 10, a block number BN is initialized to 4 0' in step 611, and a 

10 block #BN is accessed in step 613. It is determined in step 615 whether the accessed 
block #BN is a character block or a background block. If the accessed block #BN is a 
character block, neighboring blocks of the character block are grouped in step 617, 
creating a grouped block. In step 619, a pixel threshold Pth is calculated using the 
grouped block. In step 621, a pixel number PN of the character block is initialized to 

15 '0', and in step 623, a pixel with the pixel number PN is accessed. Thereafter, in step 
625, the accessed pixel is compared with the pixel threshold Pth, to binarize the 
accessed pixel into a pixel having a brightness value a or a pixel having a brightness 
value p. That is, if a brightness value of the accessed pixel is larger than or equal to the 
pixel threshold Pth, the corresponding pixel is converted into a pixel having a brightness 

20 value a in step 627. In contrast, if a brightness value of the accessed pixel is less than 
the pixel threshold Pth, the corresponding pixel is converted into a pixel having a 
brightness value P in step 629. Thereafter, in step 631, it is determined whether the 
binarization for all pixels in the corresponding block is completed. If the binarization 
operation is not completed, the method increases the pixel number by one in step 633, 

25 and then returns to step 623 to repeatedly perform the above binarization process. In 
contrast, if the binarization operation is completed, all pixels in the character block are 
binarized into pixels having a brightness value a or p. However, if it is determined in 
step 615 that the accessed block is a background block, steps 635 to 641 are performed 
to collectively convert all pixels in the background blocks into pixels having a 

30 brightness value p. 

After the binarization is performed on the character blocks, it is determined in 
step 643 whether a currently binarized block is the last block of the image. If the 
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currently binarized block is not the last block of the image, the method increases the 
block number BN by one in step 645, and then returns to step 613 to repeatedly perform 
the above operation. Through repetition of the above operation, pixels in the character 
blocks and background blocks of the image are binarized. If it is determined in step 643 
5 that the last block of the image is binarized, the binarization result values of the image 
are stored in step 647. 

In FIG 10, the block grouping of step 617 and the pixel threshold Pth 
calculation of step 619 may be performed before the binarization operation. In this case, 

10 after the block classification operation is performed, block grouping and pixel threshold 
Pth calculation procedures are performed on each of the character blocks and then the 
calculated pixel thresholds Pth are stored in a region with a corresponding character 
block number BN of a memory (not shown). Thereafter, if it is determined in step 615 
that the accessed block is a character block, the pixel threshold Pth of the corresponding 

15 character block is accessed and then the steps 621 to 633 are performed using the 
accessed pixel threshold Pth to binarize pixels in the character block. 

Referring now to FIG 8, thereafter, in step 414, the binarized image is 
subjected to vertical subsampling at a predetermined ratio in order to allow character 
20 strings to allow character strings to be appropriately arranged in the form of stripes in 
the following candidate stripes generation process. 

Referring now to FIG 7, in step 415, candidate stripes are created using 
character strings consisting of characters in the image in which horizontal pixels are 
25 reduced. FIG. 11 is a flowchart illustrating a method for creating the candidate stripes. 

Referring to FIG 11, in step 711, the binarized character regions undergo 
dilation to generate character strings in which neighboring characters are connected to 
each other. Here, the generated character strings become candidate stripes. In step 713, 
30 the created candidate stripes undergo erosion in order to separate adjacent up and down 
candidate stripes if they are connected. 

Referring now to FIG 8, thereafter, in step 416, the image having the created 
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candidate stripes undergoes vertical subsampling at a predetermined ratio in order to 
recover an original aspect ratio from an aspect ratio changed due to the horizontal pixel 
reduction. Here, a horizontal pixel extension procedure can be performed instead of the 
vertical pixel reduction operation. In this way, an aspect ratio of the image is restored to 
5 its original aspect ratio. 

After the vertical pixel subsampling process is performed, stripes whose 
direction angles are to be calculated are selected from the candidate stripes in step 417. 
Thereafter, in step 419, direction angles of the selected stripes are calculated, and a 
1 0 direction angle having the largest count value is determined as a skew angle. 

FIG. 12 is a flowchart illustrating a method including a stripe classification 
process of step 417 and a skew angle decision process of step 419. Referring to FIG 12, 
in step 811, the candidate stripes generated from the binarized image are labeled. The 

15 labeled candidate stripes are used for calculating a direction angle. In step 813, a 
candidate stripe number CSN is initialized to '0% and in step 815, a candidate stripe 
with the CSN is accessed. In step 817, a centroid moment of the character string is 
calculated. Through steps 819 to 823, a blob size ju and eccentricity e of the accessed 
candidate stripe #CSN are calculated, and if the calculated blob size /u and eccentricity 

20 e are larger than or equal to their preset thresholds fjth and eth , the corresponding 
candidate stripe #CSN is classified as a valid stripe. Here, the blob size ju (=/^ 00 ) can 

be calculated using Equation (6), and the eccentricity e can be calculated in accordance 
with Equation (7). The eccentricity e represents a length of the candidate stripe, and the 
blob size ju represents a size of the stripe. However, in step 819 to 823, if any one or 
25 both of the blob size /u and the eccentricity e are less than their thresholds juth and 
eth, the candidate stripe #CSN is not selected as a valid stripe. That is, under this 
condition, it is determined that the corresponding candidate stripe is not appropriate for 
calculation of a direction angle, so the stripe is not selected as a valid stripe. In FIG 12, 
the blob size // is first determined, and subsequently, the eccentricity e is determined, 

30 by way of example. Alternatively, however, the eccentricity e can be first determined, 
and thereafter, the blob size /u can be determined. In addition, only any one of the blob 
size ju and the eccentricity e can be analyzed in determining whether the candidate 
stripe is a valid strip. 
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If the candidate stripe is a determined as a valid stripe through the steps 819 to 
823, a direction angle 0 of the corresponding stripe #CSN is calculated in accordance 
with FIG. 6 and Equation (8) in step 825, and the calculated direction angle G is stored 
5 in step 827. That is, if the candidate stripe is determined as a valid stripe, a direction 
angle of the stripe is calculated and stored. Through repetition of this process, direction 
angles of the stripes are accumulated, and the direction angles are identical in number to 
the stripes. 

10 After the direction angle of the stripe is stored, if a candidate stripe fails to be 

determined as a valid stripe in the steps 819 to 823, it is determined in step 829 whether 
a current candidate stripe number CSN represent the last candidate stripe. If the current 
candidate stripe is not the last candidate stripe, the procedure increases the CSN by one 
in step 831, and then returns to step 815 to access the next candidate stripe with the 

15 increased CSN and repeatedly perform the above operation on the accessed candidate 
stripe. Through repetition of such a process, it is determined whether the candidate 
stripes are valid stripes. In addition, direction angles of the determined stripes are 
calculated and accumulated. Thereafter, if it is determined in step 829 that the current 
candidate stripe is the last candidate stripe, the accumulated direction angles are 

20 analyzed to determine a direction angle having the largest count value as a skew angle, 
in step 833. 

Referring now to FIG 8, when the skew angle is determined, the image is 
rotated by the determined skew angle in step 421, to correct a skew of an object in the 
25 image. Thereafter, in step 423, a blank space occurred at corners of the image in which a 
skew of an object is corrected is filled with specified pixels. In step 425, the corrected 
image is output to the recognition part. 

r 

With reference to FIGs. 13 and 14A through 14H, a description will now be 
30 made of the method for correcting a skew of an object in an image according to an 
embodiment of the present invention. 

Here, it is assumed that an input image received in step 910 is the same as that 
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shown in FIG 14 A. The image of FIG 14A is subjected to adaptive block binarization 
in step 915, creating a binarized image shown in FIG 14B. In the binarization process, 
the received image is divided into blocks having a predetermined size, and the divided 
blocks are classified into character blocks and background blocks. Each of the character 
5 blocks is grouped along with 8 adjacent blocks, making a grouped block, and a pixel 
threshold used for classifying pixels of a block image into character pixels and 
background pixels is created from the grouped block. Thereafter, pixels of the classified 
character blocks are compared with the pixel threshold to classify the pixels into 
character pixels and background pixels, and all pixels of the background blocks are 
10 collectively converted into background pixels. As a result, in step 915, pixels of the 
input image shown in FIG 14A are binarized into character pixels and background 
pixels shown in FIG 14B. 

In step 920, the binarized image of FIG 14B is converted into an image shown 

15 in FIG 14C through horizontal subsampling. FIG 14C illustrates a resultant image 
obtained by performing 2:1 horizontal subsampling on the mage shown in FIG 14B, 
and the reason for performing vertical pixel subsampling is to allow character strings to 
be appropriately arranged in the form of stripes in the following candidate stripes 
generation process. Thereafter, in steps 925 and 930, the horizontal-subsampled image 

20 shown in FIG 14C is subjected to morphological filtering, creating candidate stripes. 
That is, in step 925, binarized character regions of the image shown in FIG 14C 
undergo dilation to connect neighboring characters to each other, thereby generating 
candidate stripes shown in FIG 14D. In step 930, the adjacent up and down candidate 
stripes connected in the dilation process are separated as shown in FIG 14E. After the 

25 morphological filter is performed, the image of FIG 14E undergoes 2:1 vertical 
subsampling in step 935 to recover an original aspect ratio of the image. FIG. 14F 
illustrates a resultant image determined by performing 2:1 vertical subsampling on the 
morphologically-filtered binarized image, and the reason for performing the vertical 
pixel subsampling is to calculate a skew angle of a character string from the reduced 

30 image. 

In step 940, candidate stripes in the image of FIG 14F are labeled, and in step 
945, a blob size and eccentricity of each of the candidate stripes are calculated, and 
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stripes used for calculating direction angles are selected. In step 950, direction angles of 
the selected stripes are calculated and accumulated. When the direction angles of the 
selected stripes are completely calculated, a direction angle having the largest count 
value among the accumulated direction angles is determined as a skew angle of the 
5 image in step 955. 

If the skew angle is determined, the input image is rotated by the skew angle in 
step 960 to correct a skew of the image as shown in FIG. 14G The skew-corrected 
image of FIG 14G has blank spaces at its corners in which no pixel exists due to 
10 rotation of the image. In order to correct the blank spaces, the corners of the image are 
filled in step 965 with the closest horizontal pixel values as shown in FIG 14H. 
Thereafter, in step 970, the skew/pixel-corrected image of FIG 14H is output to the 
recognition part. 

15 As described above, in a preprocessing operation for recognizing an image 

signal, a skew angle is determined by calculating a skew of an input image and the skew 
is corrected by rotating the input image by the skew angle, thus contributing to an 
increase in character recognition performance. In addition, blank spaces at corners of 
the image, caused by the rotation of the image, are filled with specified pixels, thereby 

20 correcting the image. 

While the invention has been shown and described with reference to a certain 
embodiment thereof, it will be understood by those skilled in the art that various 
changes in form and details may be made therein without departing from the spirit and 
25 scope of the invention as defined by the appended claims. 
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